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APPARATUS AND METHOD FOR RENDERING ANTIALIASED IMAGE 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application claims the benefits of Japanese Patent Application Numbers: 
2000-252148, filed August 23, 2000; and 2001-241292, filed August 8, 2001, the entire 
disclosures of which are hereby incorporated by reference. 

FIELD OF THE INVENTION 

The present invention relates to an apparatus and method for rendering an 
antialiased image, which are suitable for use in an entertainment system, such as a game 
machine, and a computer system. 

BACKGROUND OF THE INVENTION 

Nowadays, the advent of highly-integrated, high-speed processors and memories 
has enabled real-time generation of three-dimensional images, which has hitherto been 
difficult to achieve. Thus, for example, a video-game machine is enabled to display 
three-dimensional images with realism. 

When a three-dimensional image is displayed, the three-dimensional image is 
resolved into a plurality of polygons (that is, unit figures). Then, the entire three- 
dimensional image is rendered by rendering each of these polygons. 

Practically, the displaying of this three-dimensional image is performed by 
performing geometry processing, such as coordinate transformation, clipping processing 
and lighting processing, on data representing the polygons which constitute the three- 
dimensional image, and then performing perspective projection conversion processing 
on resultant data obtained by such geometry processing to thereby convert three- 
dimension space data into data representing pixels arranged on a two-dimensional plane. 

When such a three-dimensional image is rendered, the position of each of the 
polygons, which is represented by a floating or fixed point number, is converted into an 
integer number so as to be made to correspond to a pixel located at a fixed position on 
the screen of a display apparatus. Thus, aliasing occurs. Further, stair-step-like 
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distortions called "jaggies" of a display image are caused owing to this aliasing. An 
occurrence of such aliasing or a jaggy occurs in a three-dimensional image may give a 
sense of incongruity to a user watching the three-dimensional image. Especially, in the 
case that this three-dimensional image is a dynamic image, there is an inconvenience 
5 that a flicker is caused in this image. 

Thus, a conventional image rendering apparatus reduces jaggies by virtually 
dividing each pixel into finer units called "sub-pixels" and then calculating the intensity 
of light of each of the sub-pixels according to a ray tracing method and thereafter 
averaging the calculated intensities of light of the sub-pixels of each pixel. 

10 Further, another conventional image rendering apparatus reduces the jaggies by 

first generating a high-resolution image and then performing filtering on the image 
thereby to decrease the number of pixels and to antialias the image. 

However, generally, a dynamic image to be displayed per second is composed of 
20 to 30 frames or so. Thus, the rendering of a dynamic image to be displayed per 

1 5 second needs to perform the calculation of the intensity of light of each of the sub-pixels 
according to the ray tracing method 20 to 30 times. Therefore, the former 
conventional image rendering apparatus, which is adapted to reduce jaggies by 
calculating the intensity of light of each of the sub-pixels according to the ray tracing 
method and thereafter averaging the calculated intensities of light of the sub-pixels of 

20 each pixel, has drawbacks in that such calculations take time and that a dynamic image 
cannot be antialiased in real time. 

Furthermore, the latter conventional image rendering apparatus, which is adapted 
to antialias (that is, reduce jaggies) by first generating a high-resolution image and then 
performing filtering on the image thereby to decrease the number of pixels, has 

25 drawbacks in that a buffer memory and a Z-buffer, each of which has large capacity and 
operates at a high speed, are needed when a dynamic image is displayed, and that the 
manufacturing cost and size of the apparatus increase. 
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SUMMARY OF THE INVENTION 

The invention is accomplished in view of the aforementioned drawbacks of the 
conventional apparatuses. Accordingly, an object of the invention is to provide an 
5 image rendering apparatus of a low-cost small-sized configuration, which is enabled to 
reduce jaggies in real-time, and to provide an image rendering method enabled to 
reduce jaggies in real-time, a storage medium for storing a image rendering program 
enabled to reduce jaggies in real-time, and a server apparatus for distributing such an 
image rendering program. 

10 To achieve the foregoing object, according to an aspect of the present invention, 

there is provided an image rendering apparatus that comprises an image rendering 
means for rendering an image, an antialiased image forming means for forming a 
partially antialiased image by extracting data corresponding to a predetermined line part 
of the image rendered by the image rendering means and performing antialiasing 

15 processing on the extracted data, and overwriting means for overwriting the partially 
antialiased image Jbimed by th e an tialiased image forming means onto the image 
rendered by the image rendering means. 

Thus, according to the invention, data corresponding to, for example, a 
predetermined line part of an edge portion of a rendered image is extracted. 

20 Subsequently, antialiasing is performed on the extracted data. Thus, a partial 
antialiased image is formed. Then, this partial antialiased image is overwritten onto 
the rendered image. 

Consequently, an image, in which jaggies are reduced by performing partially 
antialiasing thereon, is obtained. Further, because the image is partially antialiased, 
25 jaggies in the image are reduced at a high speed even when low-speed and low-cost 
devices are used. Thus, it is possible to make the apparatus of a low-cost simple 
configuration performs an operation of reducing jaggies on a dynamic image in real 
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time. 

Further, to achieved the foregoing object, according to another aspect of the 
invention, there is provided an image rendering method that comprises the steps of 
rendering an image by an image rendering means, forming a partially antialiased image 
5 by extracting data corresponding to a predetermined line part of the image rendered by 
the image rendering means and performing antialiasing processing on the extracted data, 
and overwriting the partially antialiased image onto the image rendered by the image 
rendering means. 

Thus, according to the invention, data corresponding to, for example, a 
10 predetermined line part of an edge portion of a rendered image is extracted. 
Subsequently, antialiasing is performed on the extracted data. Thus, a partial 
antialiased image is formed. Then, this partial antialiased image is overwritten onto 
the rendered image. 

Consequently, an image, in which j aggies are reduced by performing partially 
15 antialiasing thereon, is obtained. Further, because the image is partially antialiased, 
jaggies in the image are reduced at a high speed even when low-speed and low-cost 
devices are used. Thus, it is possible to make the apparatus of a low-cost simple 
^nfiguration performs an operation of reducing jaggies on a dynamic image in real 
time. 

20 Furthermore, to achieve the foregoing object, according to another aspect of the 

invention, there is provided a storage medium for storing a computer program. This 
program comprises the steps of rendering an image by an image rendering means, 
forming a partially antialiased image by extracting data corresponding to a 
predetermined line part of the image rendered by the image rendering means and 

25 performing antialiasing processing on the extracted data, and overwriting the partially 
antialiased image onto the image rendered by the image rendering means. 

Thus, according to the invention, data corresponding to, for example, a 
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predetermined line part of an edge portion of a rendered image is extracted by executing 
the computer program stored on the storage medium. Subsequently, antialiasing is 
performed on the extracted data. Thus, a partial antialiased image is formed. Then, 
this partial antialiased image is overwritten onto the rendered image. 

5 Consequently, an image, in which j aggies are reduced by performing partially 

antialiasing thereon, is obtained. Further, because the image is partially antialiased, 
jaggies in the image are reduced at a high speed even when low-speed and low-cost 
devices are used. Thus, it is possible to make the apparatus of a low-cost simple 
configuration performs an operation of reducing jaggies on a dynamic image in real 

10 time. 

Further, to achieve the foregoing object, according to another aspect of the 
invention, there is provided a server apparatus that comprises a storage medium for 
storing a computer program. This program comprises the steps of rendering an image 
by an image rendering means, forming a partially antialiased image by extracting data 

15 corresponding to a predetermined line part of the image rendered by the image 
— rendering jneans and performing antialiasing processing on the extracted data, and 
overwriting the partially antialiased image onto the image rendered by the image 
rendering means. This server apparatus further comprises distributing means for 
distributing a computer program stored on the storage medium. 

20 The distributing means includes, for example, means for distributing the 

computer program in a wireless manner, in addition to means for distribution the 
computer program in a wired way through a communication network, such as the 
Internet. 

Thus, according to the invention, data corresponding to, for example, a 
25 predetermined line part of an edge portion of a rendered image is extracted by executing 
the computer program distributed by the server. Subsequently, antialiasing is 
performed on the extracted data. Thus, a partial antialiased image is formed. Then, 
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this partial antialiased image is overwritten onto the rendered image. 

Consequently, an image, in which jaggies are reduced by performing partially 
antialiasing thereon, is obtained. Further, because the image is partially antialiased, 
jaggies in the image are reduced at a high speed even when low-speed and low-cost 
5 devices are used. Thus, it is possible to make the apparatus of a low-cost simple 
configuration performs an operation of reducing jaggies on a dynamic image in real 
time. 

Further, according to another aspect of the invention, there is provided a 
computer program that comprises a step of performing, when an image is rendered, 
10 antialiasing on at least a limited portion including a predetermined line part of the image. 
Thus, an image, in which aliasing and jaggy are reduced partially, is obtained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block view illustrating a vide-game machine that is an embodiment of 
1 5 the invention; 

FIG. 2 is a block view illustrating^ graphic memory provided in the video-game 

machine; 

~FIG. 3 is a flowchart illustrating an operation of reducing jaggies, which is 
performed in the video-game machine that is the embodiment of the invention; 
20 FIG. 4 is a view illustrating contours and contour candidates extracted from an 

image to be rendered in the operation of reducing jaggies; 

FIG. 5 is a view illustrating an image to be written to a frame buffer of the 
graphic memory without performing antialiasing thereon; 

FIG. 6A and 6B are views illustrating an antialiasing operation to be performed 
25 on the extracted contours and contour candidates; 

FIG. 7 is a view illustrating the antialiased contours and contour candidates; and 
FIG. 8 is a view illustrating an image obtained by overwriting the antialiased 
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contours and contour candidates onto the image written to the frame buffer. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[Configuration of Embodiment] 
5 FIG. 1 illustrates a video-game machine to which an image rendering apparatus 

of the present invention is applied. This video-game machine has two kinds of bus 
lines, that is, a main bus 1 and a sub-bus 2, which serve as bus lines for performing data 
transmission in each block. The main bus 1 and the sub-bus 2 are connected to each 
other through a bus controller 3. The main bus 1 is used as a bus line for high-speed 
10 data transmission, while the sub-bus 2 is used for low-speed data transmission. The 
rapidity of the main bus 1 is ensured by transmitting data, which may be transmitted at a 
low speed, by using the sub-bus 2. 

The main bus 1 is connected to a main CPU (Central Processing Unit) 4 
constituted by a microprocessor for example, a main memory 5 constituted by a RAM 
15 (Random Access Memory) for example, a main DMAC (Direct Memory Access 
_Contrdler)j5, an MDEC (MPEG (Moving Picture Experts Group) Decoder) 7, and a 
GPU (Graphic Processor Unit) 8, in addition to the bus controller 3. 

The sub-bus 2 is connected to the GPU 8, a sub-CPU 9 constituted similarly as 
the main CPU 4 for example, a sub-memory 10 constituted similarly as the main 
20 memory 5 for example, a sub-DMAC 11, a ROM (Read-Only Memory) 12 for storing 
an operating system etc., an SPU (Sound Processing Unit) 13, an ATM (Asynchronous 
Transmission Mode) communication portion 14, an auxiliary storage unit 15, and an 
input device I/F (interface) 16, in addition to the bus controller 3. 

The bus controller 3 performs a connection control operation of disconnecting 
25 the main bus 1 from the sub-bus 2 or connecting the main bus 1 to the sub-bus 2 
according to circumstances. 

When the main bus 1 is disconnected from the sub-bus 2, devices connected to 
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the main bus 1 cannot access devices connected to the sub-bus 2. That is, only 
accesses to be provided among the devices connected to the main bus 1 and those to be 
provided among the devices connected to the sub-bus 2 are permitted. 

In contrast, when the sub-bus 2 is connected to the main bus 1, the devices 
5 connected to each of the main bus 1 and the sub-bus 2 can be accessed through either of 
the main bus 1 and the sub-bus 2. 

In an initial state just after power-up of this video-game machine, the bus 
controller 3 is adapted to perform a control operation in such a way as to connect the 
main bus 1 to the sub-bus 2 (that is, bring the main bus 1 and the sub-bus 2 into an open 
10 state). 

The main CPU 4 performs various kinds of control operations according to a 
program stored in the main memory 5. Practically, for example, when this video-game 
machine is booted, the main CPU 4 reads a boot program from the ROM 12 connected 
to the sub-bus 2 through the bus controller 3, and boots the video-game machine. 

1 5 Then, the main CPU 4 loads application programs (in this case, game programs and an 
image rendering program (to be d escribed later)) and necessary data into the main 
memory 5 and the sub-memory 10 from the auxiliary storage unit 15 such as a disk 
drive unit, and executes the application programs. — - - 

Furthermore, a GTE (Geometry Transfer Engine) 17 is provided in the main 

20 CPU 4. This GTE 17 has a parallel processing system for simultaneously performing a 
plurality of operations. Further, the GTE 17 performs arithmetic operations for 
geometry processing, such as coordinate transformation, light source calculation, matrix 
operations, and vector operations, at a high speed in response to requests from the CPU 
4. Moreover, the GTE 17 generates polygon data representing polygons, which 

25 constitute a three-dimensional image to be displayed, and supplies the generated 
polygon data to the main CPU 4. 

When receiving the polygon data from the GTE 17, the CPU 4 obtains two- 
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dimensional space data by performing perspective projection conversion on the received 
data. Subsequently, the main CPU 4 transfers the generated data to the GPU 8 through 
the main bus 1 at a high speed. 

Furthermore, a cache memory (or cache) 18 is provided in the main CPU 4. 
5 Thus, the main CPU 4 can speed up data processing by accessing this cache memory 1 8 
instead of the main memory 5. 

The main memory 5 stores the programs, as described above, and the data which 
is needed for the data processing in the main CPU 4. 

The main DMAC 6 performs a DMA transfer control operation on devices on the 
10 main bus 1. Further, when the bus controller 3 is in the open state, the main DMAC 5 
performs the DMA transfer control operation on the devices on the sub-bus 2 in 
addition to the devices on the main bus 1 . 

The MDEC 7 is an I/O device that can operate concurrently with the main CPU 4. 
Further, the MDEC 7 functions as an image expansion engine and reproduces image 
15 data compression-coded by utilizing, for example, MPEG techniques. 

The GPU 8 functions as a rendering processor. That is, the GPU 8 calculates 

pixel data representing pixels of the polygons according to the color data of apexes of 
the polygons and Z-values representing the depth thereof from a viewpoint, which are 
transferred from the CPU 4 at a high speed. Thereafter, the GPU 8 writes (or renders) 
20 the calculated pixel data to the graphic memory 19. Thus, an image rendering 
operation is performed. Moreover, the GPU 8 reads pixel data rendered onto the 
graphic memory 19 and outputs the pixel data in the form of video signal. 

Incidentally, the GPU 8 fetches polygon data from the main DMAC 6 and the 
devices on the sub-bus 2. Then, the GPU 8 performs rendering according to the 
25 polygon data. 

The graphic memory 1 9 is constituted by a DRAM etc. for example, and has a 
frame buffer 25, a Z-buffer 26 and a texture memory 27, as illustrated in FIG. 2. 
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The frame buffer 25 is of what is called a dual buffer configuration and has 
storage capacity of two frames. That is, the frame buffer 25 has first and second frame 
buffers (sub-buffers), each of which has storage capacity that is sufficient to store pixel 
data of one frame. The frame buffer 25 is constructed so that pixel data written to the 
5 second frame sub-buffer is read during pixel data is written to the first frame sub-buffer, 
and that pixel data written to the first frame sub-buffer is read during pixel data is 
written to the second frame sub-buffer. That is, the frame sub-buffers are alternately 
assigned to a buffer used for displaying pixel data, that is, a buffer used for reading 
pixel data therefrom corresponding to each frame, and the other frame sub-buffer is 
10 assigned to a buffer used for writing pixel data thereto. In other words, sub-buffers 
respectively assigned to the buffer used for reading pixel data therefrom, and the buffer 
used for writing pixel data thereto are switched between the first and second frame sub- 
buffers every frame. 

The Z-buffer 26 has storage capacity sufficient to store Z-values of one frame. 
1 5 This Z-buffer 26 is adapted to store a Z-value of a frontmost polygon, which is located 
nearest to a user watching the screen, of an image to be displayed on the screen. The 
texture memory 27 is adapted to store data of textures to be attached to the polygons. 

The GPU 8 is adapted to perform rendering by using these frame buffer 25, the 
Z-buffer 26, and the texture memory 27. That is, the GPU 8 causes the Z-buffer 26 to 
20 store a Z-value of a frontmost one of the polygons constituting a three-dimensional 
image, and determines according to the stored Z-value whether or not pixel data is 
rendered onto the frame buffer 25. When the pixel data is rendered thereonto, the 
GPU 8 reads data representing the texture from the texture memory 27 and then obtains 
the pixels data by using the read data. Subsequently, the GPU 8 renders the pixel data 
25 to the frame buffer 25. 

As illustrated in FIG. 1 , the sub-CPU 9 performs various kinds of processing by 
reading the programs stored in the sub-memory 10 and executing the read programs. 
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The sub-memory 1 0 is adapted to store the programs and data needed by the sub-CPU 9, 
similarly as the main memory 5. 

The sub-DMAC 1 1 performs a DMA transfer control operation on the devices on 
the sub-bus 2. The sub-DMAC 1 1 is adapted to get a bus right only when the main bus 
5 1 is disconnected from the sub-bus 2 by the bus controller 3 (that is, only in a closed 
state). 

The ROM 12 stores boot programs for both the main CPU 4 and the sub-CPU 9, 
and an operating system, etc. 

The SPU 13 receives packets transferred from the sub-CPU 9 or the sub-DMAC 
10 11, and reads audio data from the sound memory 20, which stores the audio data, 
according to a sound command included in the packet. Subsequently, the SPU 13 
supplies the audio data to a speaker unit, and causes the speaker unit to generate 
corresponding sounds. 

The ATM communication portion 14 controls communication operations (that is, 
15 ATM communication operations) to be performed through a network (NW), such as a 
public line. Thus, a user of the video-game machine is enabled to transmit data 
directly to and receive data directly from a user of another video-game machine or 
- enabled to transmit data-to -and -receive data from the latter user through the Internet or 
the center office of what is called a personal computer communication system. This 
20 enables a user of a video-game machine to play a game (for example, a battle game) on 
the network with a user of another video-game machine. 

The auxiliary storage unit 15 is an optical disk drive unit, and enabled to 
reproduce (or read) information like programs and data recorded on optical disks, such 
as a CD-ROM, a CD-RW, a DVD-ROM, and a DVD-RW. 
25 The input device I/F 16 is an interface for taking in signals corresponding to 

operations to be performed on an operation unit serving as a control pad and external 
input image (video input) and audio signals (audio input) reproduced by other devices. 
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Further, the input device I/F 16 outputs the external input signal onto the sub-bus 2. 

[Operation of Embodiment] 

(Operation of the Entire Machine) 
5 When a main power supply is turned on, the main CPU 4 reads the boot program 

from the ROM 12 and executes the read boot program in the video-game machine. 
Further, the programs and the data are read from a CD-ROM set in the auxiliary storage 
unit 15. Such programs and data are loaded into the main memory 5 and the sub- 
memory 10. Then, by executing the program in the main CPU 4 or the sub-CPU 9, the 

1 0 dynamic image and sounds of a game are reproduced (or play-bucked). 

Practically, the main CPU 4 generates polygon data for rendering polygons, 
which constitute a predetermined three-dimensional image, according to the data stored 
in the main memory 5. Then, the main CPU 4 encodes this polygon data into packets 
and supplies the packets to the GPU 8 through the main bus 1 . 

15 When receiving the polygon data, which is encoded into the packets, from the 

main CPU 4^ the GPU 8 performs rendering the polygons in the frame buffer 25 in 
sequence from the polygon according to an object to which the main CPU 4 issued an 
output instruction, by simultaneously performing Z-buffering by using the Z-buffer 26 
illustrated in FIG. 2. The image rendered in the frame buffer 25 is suitably read by the 

20 GPU 8 and then outputted in the form of a video signal. Thus, the three-dimensional 
image for the game is displayed on the two-dimensional screen of a display apparatus. 

On the other hand, the sub-CPU 9 generates a sound command, in response to 
which the generation of sounds is performed, according to the data stored in the sub- 
memory 10. Subsequently, the sub-CPU 10 encodes this sound command into packets 

25 and supplies the packets to the SPU 13 through the sub-bus 2. The SPU 13 reads 
sound data, which is stored in the sound memory 20, according to the sound command 
issued from the sub-CPU 9, and supplies this sound data to a speaker unit. Thus, 
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sounds of BGM (Background Music) of the game and other kinds of sounds are radiated 
through the speaker unit. 

(Operation of Reducing Jaggies) 

When a three-dimensional image is rendered, the position of each of the 
polygons, which is represented by a floating or fixed decimal point number, is converted 
into an integer number so as to be made to correspond to a pixel located at a fixed 
position on the screen of the display apparatus. Thus, aliasing occurs by entailing 
stair-step-like distortions called "jaggies". 

The video-game machine, which is this embodiment of the invention, performs 
an operation of reducing jaggies, which are generated in the three-dimensional image, 
according to an antialiasing program. This antialiasing program is reproduced (or 
read) from a CD-ROM or DVD-ROM, etc. in the auxiliary storage unit 15 shown in 
FIG. 1. Alternatively, this program is downloaded by the ATM communication portion 
14 from a storage medium 22 (such as a hard disk (HDD)) provided in the 
predetermined server apparatus 21 through the communication network NW such as the 
Internet. 

This antialiasing program includes routines illustrated in the flowchart of FIG. 3. 
The execution of the antialiasing program illustrated in this flowchart is started when 
the program is loaded into the main memory 5 and put into an executable state after the 
main power supply for this video-game machine is turned on and the program is 
received from the auxiliary storage unit 15 or the server apparatus 21 shown in FIG. 1. 

Incidentally, it is assumed that data needed for rendering the polygon, such as 
data representing the shape of the polygon and data concerning the light source, are 
stored in the main memory 5 at that time. 

At step SI, the main CPU 4 reads the polygon data, which is needed for 
rendering polygons that constitute a three-dimensional image of 1 frame, from the main 
memory 5 through the main bus 1 and then supplies or transfers the read polygon data 
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to the GTE 17. Subsequently, the main CPU 4 extracts contours and contour 
candidates of the three-dimensional image to be rendered, if necessary, as line data or 
line strip data according to this polygon data. The extracted data is temporarily stored 
in the cache memory 18. 
5 FIG. 4 illustrates an example of the three-dimensional image for describing the 

contours and the contour candidates thereof. Referring to FIG. 4, the "contour" is an 
outline that becomes the outward form of an object independently of a direction from 
which the contour is seen in the three-dimensional space. In contrast, the "contour 
candidate" may be employed as such an outline that becomes or dose not become the 

10 outward form of an object depending upon a direction from which the contour candidate 
is seen in the three-dimensional space. Such contours and contour candidates are 
"visually important lines" representing the parts of three-dimensional images such as 
edge portions of an object. It is preliminarily determined according to the three- 
dimensional image, which includes such lines, and the viewpoint what parts of the 

15 object respectively correspond to the "visually important lines", that is, what polygons 
respectively correspond to these lines. Consequently, the main CPU 4 extracts 
contours and contour candidates, if necessary, of the three-dimensional image as line (or 
curve) data or line strip data according to this polygon data, when transferring the 
polygon data to the GTE 17. 

20 At step SI, the extraction of the "visually important lines" is performed. Thus, 

data representing lines, which have a low probability that these lines are the outlines of 
the object (that is, these lines are visually unimportant lines), are not extracted as line 
data or as line strip data. 

Thus, at step SI, only necessary minimum line data or line strip data representing 

25 visually important portions are extracted. Further, as will be described later, 
antialiasing processing is performed on the extracted line data or line strip data. 
Therefore, the time required to perform antialiasing processing is reduced. 
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Consequently, the speed, at which the entire three-dimensional image is rendered, is 
increased. 

Next, at step S2, the main CPU 4 performs rendering processing. Practically, 
when supplied with the polygon data for rendering the polygons, the GTE 17 of the 
5 main CPU 4 performs geometry processing on each of the polygons in the three- 
dimensional space according to the position of the viewpoint. Moreover, the GTE 17 
performs perspective projection conversion processing on the data having undergone the 
geometry processing. The "viewpoint" serving as a reference point for the geometry 
processing is given by operating the operation unit by a user. 

10 Further, the main CPU 4 obtains the polygon data by calculating luminance and 

texture addresses corresponding to each of the polygons in a screen coordinate system 
upon completion of this perspective projection conversion. The main CPU 4 then 
supplies the polygon data to the GPU 8 through the main bus 1. 

When supplied with the polygon data of 1 frame from the main CPU 4, the GPU 

15 8 divides each of pixels located at the coordinates of each of the apexes (or vertexes) of 
the polygons into 16 sub-pixels (that is, one pixel divided into a 4x4 matrix of sub- 
pixels). Then, the GPU 8 obtains RGB values of the sub-pixels of the sides and inner 
portions of the polygons by performing DDA (Digital Differential Analyzer) operation 
with sub-pixel accuracy. 

20 This DDA operation is a linear interpolation to be performed between two points 

so as to obtain the RGB value of each of pixels constituting a segment that connects the 
two points with each other. That is, according to this DDA operation, one of the two 
points is set as a starting point. The other point is set as an ending point. When a 
certain value is preliminarily set at each of the starting point and the ending point, a 

25 change in the value (or a rate of change thereof) at each of the pixels of the segment is 
obtained by dividing the difference between the values respectively set at the starting 
point and the ending point by the number of the pixels of the segment drawn between 
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the starting point and the ending point. Then, the value of this rate of change is 
sequentially added (that is, accumulated) to the value set at the starting point 
correspondingly to the respective pixels of the segment from the starting point to the 
ending point. Thus, the values of the pixels of the segment drawn between the starting 
5 point and the ending point are obtained. 

Hereinafter, such an operation in the case of preliminarily giving values to sub- 
pixels pi, p2, and p3 of three apexes of a triangle polygon is described in detail by way 
of example. First, such a DDA operation is performed on each of a set of the sub- 
pixels pi and p2, and a set of the sub-pixels p2 and p3 and a set of the sub-pixels pi and 

10 p3 with sub-pixel accuracy. Thus, the polygon data Z, R, G, B, S, T, and Q 
corresponding to the sub-pixels located on the three sides of this polygon, and the 
polygon data Z, R, G, B, S, T, and Q corresponding to the sub-pixels located in this 
polygon are obtained, by using X-coordinates and Y-coordinates thereof as variables. 

The polygon data X, Y, and Z represent sets of X-coordinates, Y-coordinates and 

15 Z-coordinates of three apexes of the triangle polygon, respectively. Further, the 
polygon data R, G, and B represent the luminance values of red, green and blue colors 
at the three apexes of the polygon, respectively. Furthermore, the polygon data S, T, 
and Q represent texture coordinates (that is, homogeneous coordinates corresponding to 
the textures) at the three apexes of the triangle polygon. 

20 The video-game machine of this embodiment is adapted so that a pattern (or 

material: a texture) is added to the surface of an object by texture mapping. Thus, the 
polygon data S, T, and Q are used in this texture mapping. The texture addresses are 
obtained by multiplying each of the values S/Q and T/Q by a texture size. 

Subsequently, the GPU 8 writes the RGB values of the pixels of the polygon to 

25 the frame buffer 25 by using the Z-buffer 26. Practically, the GPU 8 obtains final 
RGB values to be written to this frame buffer 25 as follows. 

That is, the GPU 8 calculates the texture addresses U (S/Q) and V (T/Q) by 
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dividing the polygon data S and T by the polygon data Q when performing the texture 
mapping according to the polygon data X, Y, Z, R, G, B, S, T, and Q (obtained as a 
result of performing the DDA operation) of a prime sub-pixel of the sub-pixels which is 
allocated at the central of the polygons. Moreover, if necessary, the GPU 8 performs 
5 various kinds of filtering processing. Thus, the color data of textures at the X- 
coordinate and the Y-coordinate of each of the sub-pixels are calculated. Then, texture 
color data corresponding to the texture addresses U and V are read from the texture 
memory 27. 

Subsequently, the GPU 8 calculates final RGB values of each of the sub-pixels 
1 0 by performing filtering processing by mixing the RGB values of this texture color data 
and those obtained as a result of performing the DDA operation at a predetermined 
mixture ratio. Thus, polygons are constituted. Then, the GPU 8 writes the final RGB 
values to the frame buffer 25. Incidentally, the GPU 8 writes the RGB values to the 
frame buffer 25 by simultaneously performing Z-buffering by the use of the Z-buffer 26. 
1 5 FIG. 5 shows an example of an image rendered in the frame buffer 25 in this 

manner. This image shown in FIG. 5 is rendered by pasting three triangle polygons 
(triangle strips) 31 to 33 together so that the entire resultant polygon has a triangular 
shape. 

In FIG. 5, each square "□" corresponds to one pixel. A filtering operation is 
20 performed on each pixel by mixing the RGB value of the texture color data and that 
obtained as a result of performing the DDA operation at a predetermined mixture ratio. 
Thus, an image of a triangle is rendered by the entire polygon formed by performing 
such a filtering operation on each pixel. 

For readily seeing the boundaries between the triangle polygons 31, 32 and 33, 
25 each of the pixels of the straight edges (or lines) of the polygons 3 1 to 33 is indicated by 
a black square "■" in FIG. 5. Further, the image rendered in the frame buffer 25 in 
this stage does not undergo the antialiasing processing. It follows that aliasing occurs 
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in the image. 

When a predetermined image is rendered in the frame buffer 25 in this way, 
control advances to step S3 of this flowchart. At this step S3, the CPU 8 performs 
antialiasing process according to the contours and contour candidates extracted at step 
5 SI. 

As described above, when transferring the polygon data to the GTE 17, the main 
CPU 4 extracts the contours, together with the contour candidates if necessary, 
according to this polygon data as line (or curve) data or line strip data. The extracted 
data is stored in the cache memory 1 8. Subsequently, when control advances to step 

10 S3, the main CPU 4 reads the line data or the line strip data stored in the cache memory 
1 8 and supplies the read data to the GPU 8. Then, the GPU 8 obtains the ratio (that is, 
an occupancy rate) of the area occupied by a straight line to that of the area of each of 
pixels, through which the straight line passes, as an a-value (a) of each of such pixels. 
Furthermore, the GPU 8 calculates the pixel value of each of the pixels according to the 

1 5 following equation by using the a-value thereof: 

(Pixel Value) = (Source Color) x a + (Destination Color) x (1 - a) 
That is, "Pixel Value" is obtained by adding "Source Color" multiplied by "a-value" and 
"Destination ~ Color" multiplied by value "1 - a-value". Then, an a-blending 
processing (to be described later) is performed by obtaining the pixel value according to 

20 this equation. 

FIG. 6A shows the occupancy rate of each of the pixels in the case that an angle, 
which a straight line to be rendered forms with the X-axis, is equal to or more than a 
predetermined value (in this case, 45 degrees). FIG. 6B shows the occupancy rate of 
each of the pixels in the case that an angle, which a straight line to be rendered forms 
25 with the X-axis, is less than the predetermined value (in this case, 45 degrees). In 
FIGS. 6 A and 6B, for readily understanding of the invention, an ideal straight line to be 
rendered is illustrated as a hollow straight line. Further, in the case that an ideal line to 
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be rendered is a curved line, the angle, which the line to be rendered forms with the X- 
axis, is evaluated by approximating this curved line to be a straight line in each of the 
pixels. 

As is understood from FIG. 6A, in the case that an angle, which a straight line to 
5 be rendered forms with the X-axis, is equal to or more than 45 degrees, objects to be 
rendered are pixels that each include a part of the line and adjoin with each other in the 
direction of the X-axis. That is, the range of pixels, in which the straight line (that is, 
to which antialiasing process is performed) is rendered, is expanded and obtained along 
the direction of the X-axis. Similarly, as is understood from FIG. 6B, in the case that 
10 an angle, which a straight line to be rendered forms with the X-axis, is less than 45 
degrees, objects to be rendered are pixels that each include a part of the line and adjoin 
with each other in the direction of the Y-axis. That is, the range of pixels, in which the 
straight line is rendered, is expanded and obtained along the direction of the Y-axis. 
Further, the GPU 8 calculates the occupancy rate of the straight line corresponding to 
1 5 each of the pixels to be rendered and obtains values, such as 20%, 40%, 60%, and 80%, 
-- as-4he calculated occupancy rate. Moreover, the GPU J8 performs the operation based 
on the aforementioned equation (that is, performs the a-blending processing) on the 
pixel values by using the calculated occupancy rate as the a-value. 

The a- values of the pixels to be rendered, which adjoin with each other in the 
20 direction of the X-axis or Y-axis), are set so that a total of the ct-values of such pixels is 
100%. 

Furthermore, in the case of this example, for simplicity of description, the 
foregoing description of calculation of the pixel values has been given by employing 
only four kinds of values, that is, 20%, 40%, 60%, and 80% as the values of the 
25 occupancy rates. However, the actual occupancy rate is set according to the resolution 
of sub-pixels. For instance, in the case of calculating the pixel values by dividing each 
of the pixels into 16 sub-pixels (that is, a 4 x 4 matrix of sub-pixels), the occupancy rate 
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is set by employing a 16-level resolution so that the number of resolution levels, which 
are, for instance, 6.25%, 12.5%, 18.75%, is equal to the number of the sub-pixels of 
each pixel. 

FIG. 7 illustrates only the contours (or contour candidates), which are rendered 
5 by calculating the pixel values, such as RGB values, according to the occupancy rates of 
the ideal line and extracted from the aforementioned example. As shown in FIG. 7, a 
gradational image of each of the contours (or contour candidates) is thus obtained by 
performing the a-blending processing on the contours (or contour candidates). 
Consequently, antialiased less-jaggy smooth contours (or contour candidates) are 
10 rendered. 

As described above, the video-game machine of this embodiment is adapted in 
such a way as to calculate the occupancy rate with sub-pixel accuracy. Thus, the 
video-game machine of this embodiment is enabled to calculate the occupancy rate with 
finer accuracy, as compared with the conventional machine that calculates the 

1 5 occupancy rate correspondingly to each of the pixels. Consequently, in the case of this 
embodiment, the contours (or contour candidates) are rendered according to more 
suitable pixel values. Hence, much-less-jaggy smooth contours (or contour 
candidates) to be rendered are obtained. 

Subsequently, when the antialiased contours (or contour candidates) are thus 

20 formed, the GPU 8 advances to step S4 shown in the flowchart of FIG. 3, whereupon 
overwriting of the pixel values is performed. Practically, the GPU 8 overwrites the 
pixel values, which are calculated by performing the a-blending processing, onto the 
pixel values of the pixels corresponding to the contours (or contour candidates) in the 
image written to the frame buffer 25. That is, an image to finally be rendered is 

25 obtained by performing antialiasing on a part of an original image. This overwriting 
processing is performed by simultaneously referring to the Z-values of the contours (or 
contour candidates), which are stored in the Z-buffer 26. 
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Thus, data representing an image having the antialiased contours (or contour 
candidates) as shown in FIG. 8 are written onto the frame buffer 2. The GPU 8 reads 
data representing the image of 1 frame written to the frame buffer 25 and supplies a 
signal representing the read data to the display apparatus as a video signal. 
5 Consequently, a three-dimensional image having antialiased smooth contours (or 
contour candidates) is displayed on the screen of the display apparatus. 

The routines illustrated in the flowchart of FIG. 3 are continuously executed 
correspondingly to each frame during a game. Thus, all the three-dimensional images 
displayed during the game are less-jaggy images. 
1 0 Although the video-game- machine according to this embodiment employs what 

is called a Z-buffer method according to which the image is rendered in the frame buffer 
25 by using the Z-buffer 26 and performing Z-buffering, the video-game machine may 
be adapted to perform Z-sorting at step S4 before the data representing the antialiased 
contours (or contour candidates), which are obtained by the a-blending processing, is 
15 overwritten onto the data stored in the frame buffer 25. That is, a much-less-jaggy 
_highrpicturerquality three-dimensional image is formed by performing, after the Z- 
sorting is performed on the contours (or contour candidates), antialiasing thereon and 
then overwriting the data representing the antialiased contours (or contour candidates) 
onto the data stored in the frame buffer 25. 

20 

[Advantages of Embodiment] 

As is apparent from the foregoing description, the video-game machine of this 
embodiment first extracts visually important portions, such as contours or contour 
candidates, of an image to be rendered. Then, this machine performs antialiasing 
25 processing on the extracted contours or contour candidates. Subsequently, this 
machine overwrites data representing the antialiased contours or contour candidates 
onto the data representing the original image. Thus, jaggies are reduced by performing 
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antialiasing processing partially on the visually important portions, such as the contours 
or contour candidates, of the image. Consequently, a less-jaggy high-picture-quality 
image is obtained. 

Further, because this embodiment is adapted so that the antialiasing processing is 
5 performed only on the visually important limited portion of the entire image, the 
antialiasing processing is performed on the image at a very high speed even when 
inexpensive hardware is employed. Therefore, antialiasing processing can be 
performed on a dynamic image to be displayed, which is composed of, for example, 20 
to 30 frames per second, in realtime. Moreover, inexpensive hardware may be 
10 employed in the video-game machine. Thus, the invention provides a video-game 
machine of a low-cost simple configuration, which is enabled to perform antialiasing 
processing on a dynamic image. 

Furthermore, even when the video-game machine according to this embodiment 
does not have large-capacity, high-speed frame buffer and Z-buffer, this machine is 
15 enabled to perform antialiasing processing on a dynamic image. Thus, such a vide- 
game machine is realized by having a low-cost, small-sized configuration. 

Furthermore, this embodiment is adapted to selectively perform only on the 
visually important portions of the entire image. Thus, this embodiment eliminates the 
necessity for a grouping operation, such as a sorting operation, which is needed for 
20 performing antialiasing on triangle polygons in the conventional machine. 

[Other Examples of Application of the Invention] 

This embodiment is illustrative, and the invention is not limited thereto. For 
example, in the foregoing description of this embodiment, the case, in which the 
25 invention is applied to a video-game machine, has been described. However, the 
invention may be applied to an effector for providing special effects for an image, and 
to a computer graphic system such as a CAD system. 
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Further, the invention may be applied to a recording/reproducing apparatus for 
recording and reproducing an image, which is taken by a video camera, by coding the 
image so that the image is represented by polygons, and to a transmission system for 
transmitting and receiving an image coded in such a way as to be represented by 
5 polygons. In this case, an antialiased high-picture-quality reproduction image is 
obtained by employing the techniques according to the invention when the image coded 
in such a way as to be represented by polygons is decoded. 

Furthermore, although it has been described in the foregoing description of the 
aforementioned embodiment that rendering processing is performed in units of frames, 
10 the rendering processing may be performed in units of fields. Additionally, the 
invention may be applied to the case of rendering any of a dynamic image, a static 
image, and three-dimensional and two-dimensional graphics. 

Besides, although it has been described in the foregoing description of the 
aforementioned embodiment that the rendering processing is performed by executing a 
15 computer program for reducing j aggies in a processor, the rendering processing may be 
— performed by providing hardware dedicated to the rendering processing and using this 
hardware. 

Further, although frhas been described in the foregoing description of the 
aforementioned embodiment that the antialiased three-dimensional image is displayed 
20 on the screen of the display apparatus by being outputted thereto, such an image may be 
outputted to a two-dimensional output apparatus, such as a printer apparatus, and then 
printed therein. 

Furthermore, although it has been described in the foregoing description of the 
aforementioned embodiment that the antialiasing processing is achieved by performing 
25 the a-blending processing, other antialiasing techniques may be employed instead of 
such a technique of the embodiment. Further, the apparatus of the invention is adapted 
to form an antialiasing image at a high speed by selectively performing antialiasing 
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processing on a visually important portion of the image. Thus, even in the case of 
employing other antialiasing techniques, advantageous effects similar to those of the 
embodiment are obtained as long as an antialiased image is formed at a high speed by 
selectively performing the antialiasing processing. 

Needless to say, various other modifications may be made without departing 
from the spirit and scope of the invention. 

As described above, the apparatus of the invention has a low-cost, small-sized 
configuration and is, however, enabled to form an antialiased high-picture-quality image 
at a high speed. Consequently, the apparatus of the invention is enabled to perform 
antialiasing processing on a dynamic image in real time. 



